A resolution of the cosmological constant problem 
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The standard calculation of vacuum energy or zero point energy is in strong disagreement with 
observation. We suggest that this discrepancy is caused by the incomplete quantization of standard 
field theory. The vacuum energy calculation for fermions shows an unacceptable asymmetry between 
particles and anti-particles, which has to be corrected by an additional quantization step that 
reverses the order of the anti-particle operators. Boson fields can be handled similarly, but have 
to be expanded first in terms of bilinear fermion operators. After the full quantization the vacuum 
energy vanishes. This does not violate the Casimir effect as this can be explained without reference 
to the vacuum energy, as Jaffe has demonstrated elsewhere. 
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Quantum field theory (QFT) can boast impressive 
quantitative successes in its description of nature (see 
e.g. [1]). However, the enormous discrepancy between 
the theoretical calculation of the vacuum energy and ob- 
servation, known as the cosmological constant problem, 
remains a serious blemish on its record. Dirac (quoted in 
[2], p. 65) felt that - since every time physicists calculated 
the vacuum energy it came out infinite - the mathematics 
must be wrong and that the right answer is that there is 
no vacuum energy. Nonetheless, most current physicists 
seem to have accepted the reality of zero point energy and 
quantum vacuum energy. Both Weinberg [3] and Caroll 
[4] quote the Casimir effect [5] as a proof of the reality 
of zero-point energies. However, Jaffe [6] has shown that 
the Casimir effect can just as well be explained by ordi- 
nary Feynman diagrams and that the derivation of this 
effect from the zero point energy - although much sim- 
pler than the field theory calculation - is in fact heuristic 
and hides the dependence on the coupling constant. Jaffe 
also notes that the question - whether zero-point fluctua- 
tions of quantized fields are real - has a long history, with 
some prominent physicists arguing against its existence. 
In this paper we argue that the dominant vacuum energy 
term in QFT which is responsible for the cosmological 
constant problem is an artifact of the quantum calcula- 
tion and due to a missing foundational step in QFT. The 
need for new QFT foundations to deal with this discrep- 
ancy has been suggested before (e.g. by [7]), but such 
a step should not endanger the impressive quantitative 
successes of QFT already obtained. For the cases consid- 
ered our new formulation satisfies this criterion, which 
shows once again that there are often different routes in 
physics to reach the same quantitative successes. 



We start with a discussion of the fermionic case, where 
there is clear evidence that there is something wrong 
with the standard calculation of the vacuum energy. The 
quantized fermion field ip(x) is typically written as fol- 



lows: ([8], p. 145; 



p.85; [10], p.54; [11], p.228): 
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where we used Sakurai's [12] convention to indicate parti- 
cle operators with the symbol b a $ and anti-particles oper- 
ators with d a $. The creation and annihilation operators 
satisfy the anti-commutation rules: 

{frap'^g} = <W<5(P- 0), {dafrd'pf} = S a/3 6(p- q), 

(2) 

with all other anti-commutators zero. The index a(/3) 
represents the usual discrete fermion quantum numbers, 
e.g. spin, flavor and - in the case of quarks - color. The 
fermionic vacuum energy - i.e. the spatial integral over 
Too {%) - can be expressed as an integral over the fermion 
field and reads (e.g. [12], p. 150): 

E = [ d 3 qqo < 0|&LA«f " d ai ?dK\0 >= 

= E/ d3 ^°[< + > -7^3] ( 3 ) 

where we replaced J( 3 )(0) by V/(2ir) 3 . The last term 
is the fermionic vacuum energy. It is either infinite or 
enormous if we use the Planck energy as cut-off. The 
important thing to notice is that only anti-particles con- 
tribute to this vacuum energy. This enormous asymme- 
try between particles and anti-particles in this elemen- 
tary quantum calculation is not acceptable. Since the 
particle term gives the natural zero result for the vacuum 
energy, one must conclude that the quantum treatment 
of the anti-particles is deficient. However, the procedure 
to combine anti-particle creation operators with particle 
annihilation operators in the field ip, and the conjugate 
combination in ip, is well-founded and leaves no room for 
change. We thus must conclude that the usual process of 
transcribing the classical fields into quantum operators 
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is not sufficient to capture the full quantization process 
when both particles and anti-particles are present. 

To analyze this problem in more detail we consider a 
one-particle matrix element < /3|&t& 7 |a! > in the expan- 
sion of a typical field expression ^Oij). As expected this 
matrix element is associated with the one particle matrix 
element upOu a . If we do the same for anti-particles, we 
must consider — < /3|d 7 dJ|a! >, with a and [3 now anti- 
particle states. After (anti-)commuting the operators we 
get the natural result v a O vp, plus an extra term without 
clear physical significance. The natural term is similar to 
the particle result, except that the "initial" and "final" 
state have been interchanged. This was to be expected, 
as anti-particles behave in some way as particles moving 
backwards in time. However, time ordering does not exist 
in the current case with a single space-time variable, and 
initial and final now refer to the ket and bra state vector, 
with the ket vector seen as the initial state for particles. 
In keeping with this generalized notion of the ordering 
of anti-particle operators for a single space-time point, 
we suggest that the proper treatment of the operator ex- 
pressions between state vectors is to reverse the order of 
the anti-particle operators taking into account the anti- 
commutativity of the operators, but ignoring the anti- 
commutators. In this way the extra (unphysical) term(s) 
will not appear and the expression takes on a fully sym- 
metric form in the order natural to anti-particles. This 
reversal will be called the R-product and was already dis- 
covered before in the context of self-consistent field equa- 
tion solutions [13]. We stress that the R-product applies 
only to operators at the same space-time point. There 
would be no justification for adjusting the order of the 
anti-particle operators belonging to different space-time 
coordinates, as the Wick expansion already controls the 
order in that case. For the anti-particle contribution to 
the vacuum energy we now get: 

<0|M{-rf a ^-}|0>=<0|4^ ag -|0> =0. (4) 

Hence after restoring the symmetry between particles 
and anti-particles, the vacuum energy automatically van- 
ishes. This is the natural result, as already expected by 
Dirac. Because this R-product must be applied generally, 
it will also eliminate the charge and momentum vacuum 
terms. 

The usual way to eliminate the vacuum terms is via 
the normal product ([14], [12], [11]). However, this prod- 
uct is seldom seen as a principled procedure. One simply 
argues (e.g. [10]) that the absolute energy level plays 
no role in QFT, so that one is justified in omitting the 
vacuum term by applying the normal product. Some au- 
thors go further (e.g. [15], p. 103-104; [16], p. 82), stat- 
ing that the original Lagrangian must be normal ordered 
before entered into the Wick expansion. However, they 
also fall short in justifying this step physically. Because 
the obscure physical justification of this product (as it is 



characterized by [6]) one re-admits the vacuum energy in 
cosmological considerations, ignoring the normal prod- 
uct and thus re-introducing the vacuum energy leading 
to the enormous discrepancy. Instead, the R-product is 
a mandatory quantization step. For simple operator ex- 
pressions like Eq. (4), the two products yield identical 
results, so that the R-product in those cases justifies the 
application of the normal product in this context. For 
more complex expressions the two products yield very 
different results, as we will see shortly. 

We have presented the fermionic case before the bo- 
son case as the inadequacy in the fermionic case is more 
obvious. In standard QFT text books the boson case 
is introduced first as it is considered simpler and more 
instructive. However, we will argue that this simplic- 
ity is misleading and that a more subtle treatments of 
the boson case is required. Schematically, the standard 
Hamiltonian for the boson or harmonic oscillator case 
reads: 

H = \ H T}w ( a \ a k + a k 4 ) = 

= E^4 a fe + ^(^E^< ( 5 ) 

where the last term represents the vacuum energy. This 
term diverges like A 4 , where A is the cut-off in momen- 
tum space. The usual argument [4] is that the only rea- 
sonable cut-off is of the order of the Planck energy, mak- 
ing this vacuum energy density enormous. In contrast to 
the fermionic case there seems nothing obviously wrong 
with this result. As usual one can remove the vacuum 
term with the normal product, but since this product 
has no physical legitimacy this procedure does not re- 
solve the cosmological constant problem. However, there 
is a more subtle way to effect the quantization in the bo- 
son case, leading to the elimination of the vacuum energy 
term using the R-product. 

Although historically bosons (like the photon) play 
a very fundamental role in physics, in modern gauge 
theory the boson fields are postulated and required to 
realize certain gauge symmetries of the fermionic La- 
grangian. As such these boson fields are secondary, as 
they are only needed because of the presence of fermion 
fields. The equations of motion confirm this: the source 
term of the boson fields has the typical structure ^Otp, 
which suggests that the basic operator structure of bo- 
son fields can be expressed as a bilinear expansion in 
fermion fields. This is exactly, what was found in 
the self-consistent solution of quantum field equations 
[13]. Similar fermion expansions are commonplace in 
nuclear structure physics, where bosonic excitations are 
expanded in terms of particle-hole configurations (see 
e.g. [17]), although there are essential differences be- 
tween the two cases. Clearly, the underlying fermions in 
such an expansion should be massless to enable the con- 
struction of massless gluon and photon fields (QCD and 
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QED). Hence, these fermions cannot be identified with 
the massive fermions of the standard model and must 
have a more fundamental massless status. Such basic 
massless quarks also underly the self-consistent calcula- 
tions mentioned above [13], where the massive standard 
model quarks only emerge after dressing the bare quarks 
through the interactions with other fields. 

The explicit bilinear expansion will be discussed in 
more detail later, but let us first consider the conse- 
quences of such an expansion for the boson vacuum en- 
ergy schematically. We write symbolically: 

a p b a d l and a p ~* <W . (6) 

Now let us rewrite Eq. (5) using this symbolic notation. 
Since all operators in Eq. (5) refer to fields at the same 
space-time point we must apply the M-product. We ob- 
tain: 

^ J dpp {atop + ftp- at} -> 

= -bldpid^ba* - d^baibldp' . (7) 

The vacuum matrix element of the right-hand side is zero: 
in the first term because of the presence of b a i on the 
right; in the second term because of the operator dpi 
on the right. Hence, the boson vacuum energy vanishes 
under this boson representation. The final expression 
displays a beautiful symmetry between particles and anti- 
particles, represented by the symmetry b <-» d. In this 
case the normal product would lead to: 

: ^4 d P' ba ' + d P' b <*' b l d l := 2b l d l d P' b <*'' ( 8 ) 

which does not show the same elegant symmetry. Under 
the normal product the two initial terms loose their in- 
dependent character and are reduced to the same expres- 
sion. The same phenomenon holds for longer expressions: 
the R-product maintains the individual character of each 
term and ensures the symmetry between terms, while the 
normal product does not necessarily maintain the dis- 
tinction between different terms. Hence, in addition to 
having a strong physical justification, the M-product also 
yields a much more elegant formulation than the normal 
product. 

These results indicate that the boson operator expan- 
sion in terms of boson operators a and a) is incapable of 
fully capturing the quantization process. The required 
fermionic expansion suggests that the boson fields are 
composite fields, however this is not true in the tradi- 
tional sense, as the composing fermionic fields are defined 
at the same space-time point and with the same momen- 
tum (see upcoming Eq. (10)). In most respects the boson 
fields maintain their fundamental status, for example in 
the functional derivation of the field equations. Nonethe- 
less, giving up some degree of fundamentality for the bo- 
son fields is already a considerable step from a historical 



perspective and illustrates the depth to which one has to 
go to resolve the cosmological constant problem. 

An important question raised by this proposal is 
whether the new fermionic representation of bosons is 
able to reproduce the same magnificent quantitative QFT 
results as the standard boson representation. A related 
question is whether the new representation of bosons 
provides new insights in those problems in QFT which 
have not (yet) been explained satisfactory or could only 
be handled through rather artificial technical manipula- 
tions, such as the Gupta-Bleuler formulation [18], [19]. 
A full discussion of these questions lies outside the realm 
of this short paper. It is not unusual that the same phys- 
ical phenomenon can be represented by different mod- 
els or theories with the differences or inadequacies only 
showing up under special circumstances. We already saw 
above that the Casimir effect can be explained in different 
ways. Initial indications are that some standard results 
(such as the photon propagator) are easily derived within 
this new representation. 

To illustrate this new representation let us present the 
suggested form of the electromagnetic field. The usual 
representation is ([8], p. 129; [10], p. 123; [12], p. 132): 

M*)<* I ^£{a (A)t (p>^W p * + c -^. ( 9 ) 

where A = 1 and 2 correspond to the physical transverse 
waves, whereas A = and 3 correspond to the scalar 
and longitudinal component. We now must replace this 
with a similar functional expression in terms of fermionic 
creation and annihilation operators: 

v*)«E / ^{K^ v ^K,§ d U eiPX+cx -} m 

The free fermionic spinors u and v are initially defined 
for finite to, but taken to the limit to — > in the 
end. This procedure ensures that the amplitude has 
the correct final structure. The Lorentz vector struc- 
ture is now automatically implemented. The Lorentz 
condition d^A^(x) = is also automatically satisfied as 
p^(u ,7„f „ p) — 0. One can show that this amplitude 

a - 2 "'2 

yields the correct electromagnetic propagator in the limit 
that to — > 0. The derivation of the propagator is not af- 
fected by the R-product as the space-time coordinates in 
the vacuum expectation value (vev) defining the propa- 
gator are not identical. For QCD we can generalize this 
expression by including the operator A a in the matrix 
elements. However, for QCD and other non-linear theo- 
ries the bilinear expansion in Eq. (10) no longer suffices 
as the fermionic operators are iterated to higher order 
through the solution of the quantized field equations. A 
complete expansion has been carried out for the dressing 
of single quarks in Ref. [13] in a bound-state setting. A 
similar expansion should hold for scattering amplitudes. 
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In principle the fermionic expansion allows for the oc- 
currence of a new type of bosonic quantum amplitude 
which has no explicit space-time dependence. An exam- 
ple is given below: 

A(x) cx / d3 p{(K. | °Vf ) 6 1 t Vf 

+ (Vf°^,?) d a,f4,f}' (ii) 

where we did not specify the structure of the operator 
O. For a scalar operator O this amplitude behaves very 
much like a constant times an identity operator, so that 
this operator embedded within a string of other operators 
acts effectively like a constant. Such terms could play an 
important role in the satisfaction of the quantum field 
equations for non-linear fields. A quantum operator of 
this nature could well assume the role that the constant 
Higgs 'vev' plays in standard theories. A more dynamic 
origin of the Higgs mechanism is necessary as the Higgs 
'vev' itself will be zero in the current framework, ensur- 
ing the vanishing of a Higgs contribution to the vacuum 
energy, as well. These constant amplitudes would not 
have any direct influence on the scattering processes. 

It is clear that many technical issues remain due to 
the required boson expansion. However, it would be 
somewhat naive to expect that the biggest discrepancy in 
physics ever recorded could be resolved without having 
some deep consequences for QFT. The presence of vac- 
uum energy is still possible as a consequence of a non- 
zero cosmological constant. Cosmological considerations 
indicate that the value of the vacuum energy density is 
about e = 4.1 x 10~ 47 GeV 4 [20], corresponding to a cos- 
mological constant of A = 87rGe = 6.7 x 1CT 84 GeV 2 . The 
relationship of these constants to particle physics are gov- 
erned by the ratio (e/G) 1/6 = 43.1 MeV. This ratio ap- 
pears naturally when the self-consistent QFT treatment 
of single quarks is combined perturbatively with general 
relativity [13] and leads to a realistic estimate of the light 
quark masses of the standard model. 
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